
PRIORITY 
DOCUMENT 

SUBMITTED OR TRANSMITTED IN 
COMPLIANCE WITH RULE 1 7. 1(a) OR (b) 



10 / S24734 



POT 



Patent Office 
Canberra 




WITNESS my hand this 
Twenty-sixth day of August 2003 

SALES 



BEST AVAILABLE COPY 



AUSTRALIA, 



PtUents Act 1990 



PROVISIONAL SPECIFICATION 



Invention title: Improvements xelating to video transmission systems 



The Invention Is described In dte following statement: 



«M)m M01 11 18427SV1 305037001 



1S.a2002 



f^ge 1 



IMPROVEMENTS RELATING TO VIDEO TRANSMISSION SYSTEMS 
FIELD OF THE INVENTION 

This invention relates to video transmission systems for use in a wide range of activities, 
5 such as marketing, training and health. The systems involve use of a video recorder with 
a wireless connection to a computer network, through which both streamed and sn^shot 
images can be transmitted to viewers. 

SUMMARY OF THE INVENTION 
10 It is an object of the invention to provide an improved system for presenting video images 
to remote viewers, or at least to provide an alternative to existing systons. 

In one aspect the invention may broadly be said to consist in a method of providing visual 
information to a client, conq)rising: (a) operating a video camera to cieate a stream of 

15 video data, (b) transmitting flie video stream wirelessly firam the camera to a receiver, 
(c) receiving and monitoring the stream at a server connected to the receiver, (d) 
transmitting the stream fiom the server to one or more remote clients over a 
communications network, and (e) transmittmg a sn^shot image jfrom the video stream to 
a client according to a characteristic that is monitored in the stream. Preferably the 

20 characteristic is repetition of a substantially static image in ttie stream. 

In another aspect the invention may also be said to consist in a me&od of providing 
visual information to a client, comprising: (a) operating a video camera to create a stream 
of video data, (b) transmitting the video stream wirelessly firom the camera to a receiver, 

25 (c) receiving the stream at a server connected to the receiver, (d) transmitting the stream 
fcom the server to one or more ronote clients over a communications network, and (e) 
transmitting a snapshot image fiom the video stream to a cHent in response to a command 
initiated at either the camera or the SCTver. Preferably the command is created by action 
of an operator of the video camera, such as by holding the camera substantially stationary 

30 to produce a substantially stationary image for a predetermined period, or by activating a 



1 



9 • • 

photo function. Preferably the snapshot is created by processing data &om a number of 
firames in the stream. 

In still another aspect the invention consists in a system that implements a method 
5 according to either of the methods indicated above. 

The invention also consists in any altemative combination of features that are indicated or 
suggested in this specification. All equivalents of these features are considered to be 
included whether or not specifically set out. 

10 

LIST OF FIGURES 

Preferred embodiments of the invration will be described in relation to the accompanying 
drawings^ of which: 

Figure 1 shows a video transmission system having a single viewer, 
15 Figure 2 shows the system having multiple viewers and a proxy server that may 

provide a directory service. 

Figure 3 is a pictorial view of the system. 

Figure 4 is a technical schematic of the system with multiple clients. 
Figure 5 shows a static image process for sending snapshots, 
20 Figure 6 shows a request response process for sending snapshots, and 

Figure 7 illustrates a typical viewer screen in an example involving horticulture. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

Referring to the drawings it will be appreciated that the invention may be implemented in 
25 a variety of ways for a range of commercial or non-commercial purposes. Details of 
video recording equipment and computer networks on which the invention may be 
implemented will be understood by a skilled reader and need not be set out in detail. 

A video signal is taken from a video camera and transmitted to a video capture device 
30 connected to a computer. A program (the server) running on the computer commimicates 
with the video capture device to continually receive digitised images at the captiu-e 
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devices hi^est resolution. Another program (the client) running on one or a number of 
other machines makes a communication connection over a network such as the Internet or 
an intranet, to the server (eg: opens a socket over TCP/IP) to allow a bi-directional flow 
of data to and from die servo*. 
5 •■ 

The user interface of the client has one area for showing low resolution video images and 
another area for displaying higher resolution static images (snapshots). Once a 
communication connection is made the server sends a continual stream of compressed 
low resolution video images to the client. The client decompresses the stream and 
10 di^lays the updated image in the video area. 

There are a number of mediods of signalling to a server to transmit a sn2q)shot to the 
client to be displayed in tiie snapshot area. 

15 There are various methods of signalling a server to transmit high resolution static images 
to a client The methods described are from two categories. The first category of 
signalling requires user interaction with the user interface of either the client or the server 
software. The second category of signalling is based on the degree of similarity of 
consecutive video images. 



The methods of signalling are: 



User interaction category 

1. An element on the user interface of a client is cKcked and a message is sent to the 
25 server requesting a smqishot to be seat back (sni^shot pull). 

2. An element on the user interface of the server is clicked and a snapshot is sent to 
each connected client (snapshot push). 

3. An element on the user interface of the client is cUcked and a message is sent to 
the server requesting a snapshot to be sent back to all clients connected to the 

30 server (snapshot push and pull). 
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Static image category 

1 . The camera operator presses a photo button on the video camera pix)ducing a 
video signal of the same image on a number of consecutive video frames 
(snapshot push) 

2. The camera is positioned to point to an area that does not change significantly 
within a given tolerance (snapshot push). 



Static image detection to signal transmission of high resolution images to a client 

10 

The analog nature of a video signal, the transmission medium and the process of 
digitisation introduce a degree of sysl^ic noise present in ±e digitised image passed to 
the server. Random noise in an image would make it unlikely that any two images would 
be "exactly" the same. 
15 . 

If the video is a live image of a static scene then small movements of the camera or the 
scene due to vibration or wind etc. could also result in sUght differences from one image 
to another. 

20 Because of small amounts of variation in the image due to noise or movement then a 
threshold for the measurement of similarity between the current image and one or a 
number of previous images is needed. The threshold could either be selected by the user 
or can de&ult to one or a number of presets. 

25 When the server determines that the current image is static (i.e. above the given threshold 
of similarity from one or a number of previous images), a high resolution image can be 
sent to the clients currently connected to the server. 

NOTE: Averaging all the images used to determine that the current image is static 
30 will result into one new averaged image with an improved signal to noise ratio. If 



4 



10 



15 



20 



there were n images then the signal to noise ratio would increase by the 
square root of n (e.g. 9 images averaged would increase SNR by a fector of 3). 

With reference to Figure 4, the camera (10) produces a continuous video signal that is 
digitised by the video capture device (20). The server (30) captures the digitised image 
and makes a copy into a cyclic high resolution image buff» (40). Each new digitised 
image captured is passed to the static image detector algorithm (50). The static image 
detector algorithm determines if the current image is not significantly different fix>m 
previous cq>tured images. 

When users run the client program (1,2.. . .n) a communication connection is made fiom 
the client (l.l,2.!,...,n.l) to the server (60). Once a connection is made, the server sends 
a continuous stream of compressed.low resolution digital video to each client (1 .2, 

^•^ "-2). When the server (30) is signalled to send a high resolution video image, the 

server copies an image fiom the image bufier (40) and sends it to the appropriate 
client/clients (1 J, 2.3,. ..n.3). 

The methods of signalling the server to send a high resolution image to the client 
originate fiom either user interaction or when a static image is detected. 



User interaction category 

1. An element on the user interface of a cUent (n) is clicked and a message is sent 
fiom the client (n. 1) to the server (60) requesting a snapshot to be sent back. An 
image is copied firom the high resolution image buffer (40) and sent to the cUent 

25 (n.3). 

2. An element on the user interface of the server (30) is clicked. An image is copied 
fiom the high resolution image buffer (40) and sent to each connected cUent (1.3, 

3. An element on the user interface of a client (n) is cUcked and a message is sent 
from the client (n.l) to the server (60) requesting a snapshot to be sent back to all 
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clients connected to the server (1 ,2,, . .,n). An image is copied from the high 
resolution image buffer (40) and sent to each connected client (1 .3, 2.3 . .,n.3). 

Static image category 

1 . The camera operator presses a photo button on the video camera (10) producing a 
video signal of the same image on a number of consecutive video frames. The 
static image detector algorithm (40) determines that the image is static. The 
current image is copied from the high resolution image buffer (40) and sent to 
each connected client (1.3, 2.3....,n.3). 

2. The camera (10) is positioned to point to an area that does not change 
significantly wilhin a given tolerance. The static image detector algorithm (40) 
determines that the image is static. The current image is copied from the high 
resolution image buffer (40) and sent to each connected client (1 .3, 2.3 n.3). 

Figure 5 gives a server side static image signalling flowchart A camcorder 10 
continuously outputs an analog video signal 20 at a rate of 25 frames per second. The 
video signal is digitized by a video capture device 30. 

The video capture device 30 converts the analog video signal 20 to a series of pixels 
representing a digitized image 40 with nominal width and height and RGB colour dq>th 
(eg: 768 x 576 x 24bit) at a nominal frame rate (eg: 25 fys). 

Each digitized image is passed to the server 50 The server stores the current image into a 
cyclic image buffer 60 RAM at the highest resolution required. The number of images 
that can be stored in the cyclic image buffer is nominated by the user and is dependant on 
the frame rate and either the typical lag time for the round trip image data being sent and 
message returning and/or on the number of consecutive frames nominated to determine a 
static ima^, (eg: two seconds worth of images). 

The current image is then compared with any previously sent static images 70 a number 
of images in the cycUc image buffer 80. The server is signalled to send a static image to 
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the client on the conditions when the current image is significantly different to the 
previously sent static image and the current image is significantly similar to the other 
images in the cycUc image buffer. The static image is stored for later comparison and 
then sent to the client 90. 

5 

Figure 6 gives a client side static image signalling flowchart. A camcorder 10 
continuously outputs an analog video signal 20 at a rate of 25 frames per second. The 
video signal is digitized by a video capture device 30. 

10 The video capture device 30 converts the analog video signal 20 to a series of pixels 
representing a digitized image 40 with nominal width and height and RGB colour depth 
(eg: 768 x 576 x 24bit) at a nominal fiame rate (eg: 25 §)s). 
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Each digitized image is passed to the server 50 The server stores the current image into 
15 cyclic image buffer 60 RAM at the highest resolution required. The number of images 
that can be stored in the cycUc image buffer is nominated by the user and is dependant 
the fiame rate and either the typical lag time for the round trip image data being sent and 
message returning and/or on the number gf consecutive frames nominated to detemiine a 
static image, (eg: two seconds worth of images). 

20 

A viewer viewing the low resolution video cHcks on an element on the user interfece. 
This interaction initiates a message to be sent from the client to the server requesting that 
a high resolution image be sent back. The server checks for messages on each new frame. 
The next digitized image aftei^ a message has been received is then stored for possible 
25 later comparison and flien sent to ttie client 90. 



The invention enables a wide range of commercial and non-commercial interactions. It 
can be provided as a hardware and software package that converts a camcorder into a 
wireless webcasting system by inserting a video transmission device into the hot shoe of 
30 a camcorder, which transmits live or recorded video signals to a base station which is 
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connected to a network such as the Internet or an Intranet, and receives, compresses and 
serves the images via to one, few or many viewers via a web browser interfece. 

In this form the invention aUows real-time, virtual meetings between the vendor and its 
customers. Vendors can talk on the phone to customers while using a video camera to 
take video footage, which is immediately visible to the customer via the vendors' website. 
The wireless technology allows difficult camera placements and unusual camera angles, 
so just about any view of the subject, product or event can be easily seen and in mtense 
detail (using the snapshot function which enables the vendor and the viewer to capture 
higji resolution stills at the click of a button). 

Use of the invention overcomes the baniers of remoteness by allowing products to be 
presented live and online, reducing travelling costs, increasing productivity and 
improving market reach. 

How it works: 

• A device is attached to a hot shoe to a camcorder (powered fiom the camcorder or a 
device battery). . 

• The device transmits live or recorded video signals back to a base station equipped 
with video capture device. 

• The server software running on the base station communicates with the video capture 
device to continually receive digitised images at the capture devices highest 
resolution. 

• The client program running on a machine make a commvnication connection to the 
server via a network such as the Internet or an intranet, to allow a bi-directional flow 
of information to and fiom the server. 

• This aUows the 'viewer' at the client side to view the invention interface via a 'users' 
web page. 

• The interfece consists of low quality streaming video images on one side of the screen 
and a display firame for higher resolution static images (snapshots) on the other. 



8 



• Once a communication connection is made the server software sends a continual 
stream of compressed low resolution video images to the client software. The client 
software decompresses the stream and displays the updated image in the video area. 

• The viewer^s can securely access these images via a web browser. 

5 • The viewer/s and user can take a 'snapshot' image from the video by: 

o A viewer clicks on the streaming video via the invention interface to receive a 
snapshot; 

o A viewer clicks on the streaming video via the invoition inter&ce to send a 
'sm^shot* to all session viewers; 
10 o the user selects the *take a still' fimction on the invention server software; 

o the user selects the *sn^>shot' ftmction on their personal video camera; 

• The viewer/s or user can save 'snapshots* 

• The viewer/s or user can print 'snapshots* 

• As new 'snapshots* are taken, the replaced images appear as thumbnail images 
1 5 underneath tiie main high-resolution image. 

• These individual image thumbnails are then viewed in full size in the display image 
frame by the viewer performing a mouse rollov^- on individual thumbnails. 

Possible implementation and use of the invention 
20 User installs server software onto PC, which has a video capture de^dce. The PC is 

connected to an Internet connection. An RF receiver is then attached to flie PC, creating a 
base station (a PC M^fli server software, connected to the Intemet, vwtii receiver attached). 

The user then inserts tiie invention transmitter into tiie intelUgent hot sho? of the personal 
25 video camera (camera powered version) or into a standard hot shoe (battery operated 
version). 

When the camera is powered on, the transmitter receives video images from the camera 
video out, and transmits video images back to tiie receiver, which is connected to the base 
30 station. The server software tiien receives and compresses tiie images, tiien transfers them 
to the users web server. 
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When the images are received 6om the server software, the server then serves the images 
via the cUent interfece on the user's website. The viewer then views these images (live or 
recorded) via a standard web browser. 

5 

A snapshot image is used to allow the viewer to gain a clear, detailed image, accurate 
enough to allow for consultation, or purchase decision-making. Taking a snapshot also 
aUows the user and viewer/s to emphasis a particular feature of interest, eg. a single 
viewer can 'take' a snapshot, which can be seen by all viewers and the user, to clearly 
10 indicate which product or feature they are referring to. Snapshots maybe numbered to 
allow easy reference. 

The image can be triggered in four ways: The viewer clicks on the streaming video via 
the web browser, which sends a message to the server to send a hi^ resolution still 
image to that viewer only. The viewer clicks on the streaming video via the web browser, 
which sends a message to the server to send a high resolution still image to all viewers 
participating in the session. The user selects the 'take a snapshot' function on the server 
software, which sends a high resolution image to the viewer. The user selects the 
•snapshot' fimction on their personal video camera to send a stUl image to the viewer. 

The invention allows the most natural remote communication process. Using traditional 
fixed or mobile phone lines for audio communication means there are no, or mmimal 
delays, which is important as research shows that more than Va second delay causes 
significant interference with the communication process. 

25 

The wireless technology allows flie user to walk around freely without being tangled in 
cables, and tiie camcorder flip-out screen ensures that the user and viewer seeing the 
same subject matter. A viewer can request the operator of tiie camera to survey particular 
objects. Requests can be tansmitted in various ways including fixed or mobile 
30 telephone, or over the Internet. 
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The wide range covered by the invention allows users to transmit ima^ from a large 
area of their business, for example, large machinery sheds, livestock sheds, crop fields, 
paddocks, etc. This allows minimal disruption to the business (eg. items don't need to be 
moved to be viewed) and allows the user to seek specialist advice while keeping infected 
5 crops or livestock separated from 'clean' produce. 

The sn^shot functionality mimics the natural communication action of emphasis or 
pointing. As both the user and the viewer have the ability to trigger a snapshot which can 
be viewed by all involved in the session, this serves to allow all parties involved in the 
10 session to use a snapshot to 'point' to particular views of a product, vMch clearly 
communicates vdiat is subject of discussion. 

All users can also view 'session' thumbnails as separate from mdividually requested 
thumbnails, and these are numbered. This allows ussacs to refer to previous subjects eg. "if 
15 you compare flower in tiiumbnail 5 to the one in thumbnail 8, it is much healthier". This 
allows all viewers to easily compare a number of products or subjects. 

The invoition can be used for: 
Marketing and selling goods: 

20 It can be very difficult for producers of perishable products of variable quality (eg. fruit, 
plants, livestock) to sell sign unseen to a buyer, which represents an enormous problem 
for businesses that are attempting to reach markets outside their local area. Wholesale 
nurseries, particularly ones with large and varied product ranges continually fru^e fliis . 
issue because plant quality varies so much, so quickly. Standard practice is tiiat the 

25 wholesaler drives a van of their latest products around to all tiie buyers to display their 
product (the 'spec truck'), and then the buyers place their orders on the spot. This is a 
very time consuming process, the tiavel costs are high, plants will often not look their ' 
best due to travel stress, and it requires a staff member to be out on tiie road and not in the 
nursery. 

30 
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With the invention, buyers can view the produce &om their desks - it's easier for tfiem, 
and much easier for the nurseryman. The intoactive nature of the invention means that 
buyers can instruct the vendor to show than all aspects of the plant (including root 
system etc.) and they can use the snapshot feature to gain accurate images of plant colour 
5 etc. 

Also, by cutting out the previously necessary travel for sales meetings, an online meeting 
with a client can be held at short notice, greatly reducing the length of the sales cycle. 

1 0 Communications with the export ntiaric^: 

One of the major barrios recognised for businesses trying to access export industries is 
access to, and communication with export markets, particularly for sellers of livestock 
and peri^able goods such as fruit, vegetables and plants. 

For example, a cherry grower in Tasmania exports their goods around Australia, and also 
1 5 overseas. The invention allows the grower to walk around his orchard, packing room, and 
transport equipment and not only show the potential buyer his produce, but also how that 
produce wiU be stored, packed and transported to the client. The snapshot feature allows 
the client to inspect the fruit for colour, blemishes, disease size. Also, the interactivity of 
the process allows the client to request to view particular angles of equipment, trees or 
20 fruit. 

The invention allows vendors to develop personalised 'face-to-face' relationships with 
buyers, and display all aspects of their goods, and the related production, growing, 
storage and transport fecilities. Such visual inspections and transparency of business 
25 processes builds confidence and understanding between vendors and buyers. The 

invention greatly improves market reach at minimal cost, and in a time-effective inanner. 

Provision of remote technical and mechanical support ronotely: 
Technical downtime rq)resents a substantial expense to large machinery companies. For 
30 example, the majority of mining industry sites are located in remote areas, and due to the 
high cost of replacement parts, don't carry full replacement parts at aU sites. When a 
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technical issue is feced, either the onsite staff would send the failed part back to the 
manufecturer and request a replacement, or call for onsite assistance fiom a technical 
specialist. However, this is a costly and time-consuming process, the available technical 
specialists are limited and mechanical downtime can represent tens of thousands of 
dollars lost revenue p^ hour. 

The invention will allow onsite staff to use live video to display equipment operation or 
damage to mechanical support specialists located at other sites, allowing them to quickly 
identify what action or parts are required to ensure that equipment is back up and running 
fast to minimise the expense of downtime. The flexibility allowed using a wii«less 
solution aUows video and snapshots of aU angles of 'haid to reach' machinery. The Uve, 
interactive nature of the invention allows the technical specialist to direct the onsite staff 
to try possible solutions, replace parts and generally perform a range of troubleshooting 
actions which can provide a solution or allow the mechanical support specialist to 
idoitify the ^test way repair the system and return to normal production levels. 

This process saves the company travel costs and minimises downtime, and increases the 
productivity of technical support specialists. 

Provision of remote medical consultation: 

The invention allows medical practitioners who are separated by distance to make a 
detailed consultation of a patient, utiKsing video and high resolution stills to make a 
diagnosis and agree on a course of action. This is particularly useful due to the demand 
on specialists who are often based in metro areas. This allows remote specialist 
consultation to medical facilities in rural, remote areas around the world. 

Provision of remote veterinarian sovices: 

The invention will be used by veterinarians to aUow remote consultation and diagnoses, 
but also instract and undertake autopsies. Eg. the invention will be used by a pig 
veterinarian specialist to instruct a onsite pig feimer to perform an autopsy (which must 
be performed within hours after the death) remotely. The pig veterinarian can take and 
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save snapshots as a record of the autopsy, which can then be used to compare with future 
autopsy, and identify patterns, ne«v diseases etc. The wireless functionality and use of a 
camcorder allows a flexible range of camera angles, and allows the user to perform the 
initial diagnoses and autopsy at the site of death, to avoid possible infection of other 
animals. 



Provision of agricultural consultation services: 

Agricultural consultation is avaUable in many fields, however, specialists in many areas 
are limited, and it is not cost or time effective to engage a speciaUst consultant to travel to 
a specific location to inspect Uvestock, plants etc. especially as the symptom may only be 
present temporarily (eg. a cow with the initial signs of a disease will have moved to a 
secondary stage by the time a consultant is available to inspect it.). 

For example, flie invention can be used for a plant grower in regional Victoria, AustraUa 
to consult with a Calla Lilly speciaUst in New Zealand about an issue with leaf 
discolouration in a crop of Calla LiUies. The specialist can make a diagnoses and 
recommend a course of action after instructing the grower to show various views of tiie 
plant, allowing him/her to gather the appropriate snapshots to display a detailed view of a 
variety of aspects of the plant The consultant is then able to regularly monitor the 
progress of the crop - finom New Zealand. 



It can be used by, for example: 

• Primary producers 

• Technical support companies 

• Exporters 

• Medical consultation 

• Veterinarians 

• Building and construction industry 

• Real estate 

• Car sales 

• Education sector 
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Once the invention is installed, vendors/consultants/technical specialists can talk on the 
telephone to their cUents whilst using a camcoKler to take video footage, which is 
immediately visible to the client via the selected website. 

Expected advantages over other systems 

• Provides video and high quality stills simultaneously, with the user or viewer/s able to 
•take a photo' at any time from the browser, server software or camcoider. 

• Wireless technology fecihtates difficuh camera placements and unusual camera 
angles. 

• Combination of low quality streaming video and high quality snapshots. 

• Snapshots can be printed and saved fix>m web browser interface. 

• No plug-ins or special software or hardware required at vieweis end. 

• Theusercancontrolplaybackofrecoided video, and utilise camcorder functionality 
of play, pause, rewind and fest-forward, which can be displayed to the viewer/s. 

• Uses a camcorder as the webcasting system, allowing high quality images and 
flexibility of camera angles and views of subjects; and aUows the user to see what the 
viewer sees through the flip out screen. 

• Uses wu-eless transmitters to allow user to walk around freely. 

• Users and viewers can 'take' a high-resolution snapshot in a variety of ways. 

• Mobile, wireless webcasting not currency available. 

• Uses an analogue RF video transmission signal (not bluetooth) providing more 
tolerance over longer ranges. 

• High resolution images can be printed or saved from web browser, allowing the 
viewer or user to keep a record of the session. 

• Viewers do not require specific hardware, software, plugins etc - a standard browser 
is required only. 

• The transmitter device can be powered from the camcoider, therefore requiring one 
less device to be charged. 

• The transmitter device can be powered an onboard battery. 
MOMENTUM TECHNOLOGIES GROUP ig August 2002 
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